From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtp-fw-2101.amazon.com (smtp-fw-2101.amazon.com [72.21.196.25]) by dpdk.org (Postfix) with ESMTP id AFEB7156 for ; Thu, 7 Nov 2013 04:43:46 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=@amazon.com; q=dns/txt; s=amazon201209; t=1383795880; x=1415331880; h=from:to:subject:date:message-id:references:in-reply-to: content-transfer-encoding:mime-version; bh=ctXGazy5AVcSEMP1e9QT01XiqBT4aC80Ch7bXkatwRI=; b=qoo6A9XDh6cuZPceuXugKkvurYn20VrhyUhyWsyDFVrOXY9SmIvHD2TQ VudzM/FYDdjArxcuksHBcPG1OJV2IacC0MTGQfQAmF2caycABJmciG848 tE/YfoDVg6Uq5MMoKxCiLVnbU5/ir/nwkhW3aAOlFdcjHgTZZJLEYin6o c=; X-IronPort-AV: E=Sophos;i="4.93,649,1378857600"; d="scan'208";a="47423" Received: from smtp-in-1001.vdc.amazon.com ([10.118.83.13]) by smtp-border-fw-out-2101.iad2.amazon.com with ESMTP/TLS/DHE-RSA-AES256-SHA; 07 Nov 2013 03:44:39 +0000 Received: from ex10-hub-31002.ant.amazon.com (ex10-hub-31002.sea31.amazon.com [10.185.169.193]) by smtp-in-1001.vdc.amazon.com (8.14.7/8.14.7) with ESMTP id rA73ia9b002663 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=OK) for ; Thu, 7 Nov 2013 03:44:39 GMT Received: from EX10-MBX-36002.ant.amazon.com ([fe80::cd97:16ef:48e8:b9f5]) by ex10-hub-31002.ant.amazon.com ([::1]) with mapi id 14.02.0342.003; Wed, 6 Nov 2013 19:44:32 -0800 From: "Benson, Bryan" To: "dev@dpdk.org" Thread-Topic: RX checksum offloading Thread-Index: Ac7bS6VHDEWA3z2uR/6QWCn3UF0daAAGLuCOAAHFf9w= Date: Thu, 7 Nov 2013 03:44:32 +0000 Message-ID: References: , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.17.1.118] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Precedence: Bulk Subject: Re: [dpdk-dev] RX checksum offloading X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Nov 2013 03:43:47 -0000 Didn't realize attachments were stripped - here is the full text - sorry fo= r the SPAM!=0A= =0A= =3D=3D Full text of the rx checksum issues testing & validation =3D=3D=0A= =0A= 0, 8, 16, 24, 28, 30, 31 are okay.=0A= =0A= Values above 32 are not (tested with 32, 64 and 128)=0A= =0A= [bmbenson]~/1.3.1.1/DPDK% sudo ./x86_64-default-linuxapp-gcc/app/testpmd -= c 0xFF00FF00 -n 4 -b 0000:06:00.0 -- --portmask=3D0x3 --nb-cores=3D2 --enab= le-rx-cksum --disable-hw-vlan --disable-rss --crc-strip --rxd=3D1024 --txd= =3D1024 -i =0A= EAL: coremask set to ff00ff00=0A= EAL: Detected lcore 8 as core 0 on socket 0=0A= EAL: Detected lcore 9 as core 1 on socket 0=0A= EAL: Detected lcore 10 as core 2 on socket 0=0A= EAL: Detected lcore 11 as core 3 on socket 0=0A= EAL: Detected lcore 12 as core 4 on socket 0=0A= EAL: Detected lcore 13 as core 5 on socket 0=0A= EAL: Detected lcore 14 as core 6 on socket 0=0A= EAL: Detected lcore 15 as core 7 on socket 0=0A= EAL: Detected lcore 24 as core 0 on socket 0=0A= EAL: Detected lcore 25 as core 1 on socket 0=0A= EAL: Detected lcore 26 as core 2 on socket 0=0A= EAL: Detected lcore 27 as core 3 on socket 0=0A= EAL: Detected lcore 28 as core 4 on socket 0=0A= EAL: Detected lcore 29 as core 5 on socket 0=0A= EAL: Detected lcore 30 as core 6 on socket 0=0A= EAL: Detected lcore 31 as core 7 on socket 0=0A= EAL: Setting up hugepage memory...=0A= EAL: Ask a virtual area of 0x400000000 bytes=0A= EAL: Virtual area found at 0x7f17c0000000 (size =3D 0x400000000)=0A= EAL: Requesting 16 pages of size 1024MB from socket 0=0A= EAL: WARNING: Cannot mmap /dev/hpet! The TSC will be used instead.=0A= EAL: Master core 8 is ready (tid=3Ddbe54800)=0A= EAL: Core 10 is ready (tid=3Dda68f700)=0A= EAL: Core 12 is ready (tid=3Dd968d700)=0A= EAL: Core 13 is ready (tid=3Dd8e8c700)=0A= EAL: Core 24 is ready (tid=3Dd2ffd700)=0A= EAL: Core 14 is ready (tid=3Dd3fff700)=0A= EAL: Core 25 is ready (tid=3Dd27fc700)=0A= EAL: Core 9 is ready (tid=3Ddae90700)=0A= EAL: Core 15 is ready (tid=3Dd37fe700)=0A= EAL: Core 27 is ready (tid=3Dd17fa700)=0A= EAL: Core 28 is ready (tid=3Dd0ff9700)=0A= EAL: Core 30 is ready (tid=3Dbf7fe700)=0A= EAL: Core 26 is ready (tid=3Dd1ffb700)=0A= EAL: Core 29 is ready (tid=3Dbffff700)=0A= EAL: Core 11 is ready (tid=3Dd9e8e700)=0A= EAL: Core 31 is ready (tid=3Dbeffd700)=0A= EAL: probe driver: 8086:10d3 rte_em_pmd=0A= EAL: probe driver: 8086:10fb rte_ixgbe_pmd=0A= EAL: unbind kernel driver /sys/bus/pci/devices/0000:84:00.0/driver/unbind= =0A= EAL: bind PCI device 0000:84:00.0=0A= EAL: Device bound=0A= EAL: map PCI resource for device 0000:84:00.0=0A= EAL: PCI memory mapped at 0x7f1bdbdf0000=0A= EAL: probe driver: 8086:10fb rte_ixgbe_pmd=0A= EAL: unbind kernel driver /sys/bus/pci/devices/0000:84:00.1/driver/unbind= =0A= EAL: bind PCI device 0000:84:00.1=0A= EAL: Device bound=0A= EAL: map PCI resource for device 0000:84:00.1=0A= EAL: PCI memory mapped at 0x7f1bdbdd0000=0A= Interactive-mode selected=0A= Configuring Port 0=0A= PMD: Disable RSC=0A= PMD: Saved register RXCSUM:3000=0A= Configuring Port 1=0A= PMD: Disable RSC=0A= PMD: Saved register RXCSUM:3000=0A= Checking link statuses...=0A= Port 0 Link Up - speed 10000 Mbps - full-duplex=0A= Port 1 Link Up - speed 10000 Mbps - full-duplex=0A= Done=0A= testpmd> set fwd csum=0A= Set csum packet forwarding mode=0A= testpmd> start=0A= csum packet forwarding - CRC stripping enabled - packets/burst=3D16=0A= nb forwarding cores=3D2 - nb forwarding ports=3D2=0A= RX queues=3D1 - RX desc=3D1024 - RX free threshold=3D0=0A= RX threshold registers: pthresh=3D8 hthresh=3D8 wthresh=3D4=0A= TX queues=3D1 - TX desc=3D1024 - TX free threshold=3D0=0A= TX threshold registers: pthresh=3D36 hthresh=3D0 wthresh=3D0=0A= TX RS bit threshold=3D0 - TXQ flags=3D0x0=0A= testpmd> stop=0A= =0A= Telling cores to stop...=0A= Waiting for lcores to finish...=0A= =0A= ---------------------- Forward statistics for port 0 -------------------= ---=0A= RX-packets: 490511 RX-dropped: 0 RX-total: 490511=0A= Bad-ipcsum: 490496 Bad-l4csum: 0 =0A= TX-packets: 488720 TX-dropped: 0 TX-total: 488720=0A= -------------------------------------------------------------------------= ---=0A= =0A= ---------------------- Forward statistics for port 1 -------------------= ---=0A= RX-packets: 488804 RX-dropped: 0 RX-total: 488804=0A= Bad-ipcsum: 0 Bad-l4csum: 488704 =0A= TX-packets: 490511 TX-dropped: 0 TX-total: 490511=0A= -------------------------------------------------------------------------= ---=0A= =0A= +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++= ++=0A= RX-packets: 979315 RX-dropped: 0 RX-total: 979315=0A= TX-packets: 979231 TX-dropped: 0 TX-total: 979231=0A= +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= +++=0A= =0A= Done.=0A= =0A= [bmbenson]~/1.3.1.1/DPDK% sudo ./x86_64-default-linuxapp-gcc/app/testpmd -c= 0xFF00FF00 -n 4 -b 0000:06:00.0 -- --portmask=3D0x3 --nb-cores=3D2 --enabl= e-rx-cksum --disable-hw-vlan --disable-rss --crc-strip --rxd=3D1024 --txd= =3D1024 --rxfreet=3D16 -i=0A= EAL: coremask set to ff00ff00=0A= EAL: Detected lcore 8 as core 0 on socket 0=0A= EAL: Detected lcore 9 as core 1 on socket 0=0A= EAL: Detected lcore 10 as core 2 on socket 0=0A= EAL: Detected lcore 11 as core 3 on socket 0=0A= EAL: Detected lcore 12 as core 4 on socket 0=0A= EAL: Detected lcore 13 as core 5 on socket 0=0A= EAL: Detected lcore 14 as core 6 on socket 0=0A= EAL: Detected lcore 15 as core 7 on socket 0=0A= EAL: Detected lcore 24 as core 0 on socket 0=0A= EAL: Detected lcore 25 as core 1 on socket 0=0A= EAL: Detected lcore 26 as core 2 on socket 0=0A= EAL: Detected lcore 27 as core 3 on socket 0=0A= EAL: Detected lcore 28 as core 4 on socket 0=0A= EAL: Detected lcore 29 as core 5 on socket 0=0A= EAL: Detected lcore 30 as core 6 on socket 0=0A= EAL: Detected lcore 31 as core 7 on socket 0=0A= EAL: Setting up hugepage memory...=0A= EAL: Ask a virtual area of 0x400000000 bytes=0A= EAL: Virtual area found at 0x7fdc40000000 (size =3D 0x400000000)=0A= EAL: Requesting 16 pages of size 1024MB from socket 0=0A= EAL: WARNING: Cannot mmap /dev/hpet! The TSC will be used instead.=0A= EAL: Master core 8 is ready (tid=3D7476d800)=0A= EAL: Core 9 is ready (tid=3D737a9700)=0A= EAL: Core 12 is ready (tid=3D6bfff700)=0A= EAL: Core 15 is ready (tid=3D70fa4700)=0A= EAL: Core 10 is ready (tid=3D72fa8700)=0A= EAL: Core 14 is ready (tid=3D717a5700)=0A= EAL: Core 11 is ready (tid=3D727a7700)=0A= EAL: Core 13 is ready (tid=3D71fa6700)=0A= EAL: Core 27 is ready (tid=3D69ffb700)=0A= EAL: Core 28 is ready (tid=3D697fa700)=0A= EAL: Core 25 is ready (tid=3D6affd700)=0A= EAL: Core 31 is ready (tid=3D5b7fe700)=0A= EAL: Core 24 is ready (tid=3D6b7fe700)=0A= EAL: Core 30 is ready (tid=3D5bfff700)=0A= EAL: Core 29 is ready (tid=3D68ff9700)=0A= EAL: Core 26 is ready (tid=3D6a7fc700)=0A= EAL: probe driver: 8086:10d3 rte_em_pmd=0A= EAL: probe driver: 8086:10fb rte_ixgbe_pmd=0A= EAL: unbind kernel driver /sys/bus/pci/devices/0000:84:00.0/driver/unbind= =0A= EAL: bind PCI device 0000:84:00.0=0A= EAL: Device bound=0A= EAL: map PCI resource for device 0000:84:00.0=0A= EAL: PCI memory mapped at 0x7fe074709000=0A= EAL: probe driver: 8086:10fb rte_ixgbe_pmd=0A= EAL: unbind kernel driver /sys/bus/pci/devices/0000:84:00.1/driver/unbind= =0A= EAL: bind PCI device 0000:84:00.1=0A= EAL: Device bound=0A= EAL: map PCI resource for device 0000:84:00.1=0A= EAL: PCI memory mapped at 0x7fe0746e9000=0A= Interactive-mode selected=0A= Configuring Port 0=0A= PMD: Disable RSC=0A= PMD: Saved register RXCSUM:3000Configuring Port 1=0A= PMD: Disable RSC=0A= PMD: Saved register RXCSUM:3000Checking link statuses...=0A= Port 0 Link Up - speed 10000 Mbps - full-duplex=0A= Port 1 Link Up - speed 10000 Mbps - full-duplex=0A= Done=0A= testpmd> set fwd csum=0A= Set csum packet forwarding mode=0A= testpmd> start=0A= csum packet forwarding - CRC stripping enabled - packets/burst=3D16=0A= nb forwarding cores=3D2 - nb forwarding ports=3D2=0A= RX queues=3D1 - RX desc=3D1024 - RX free threshold=3D16=0A= RX threshold registers: pthresh=3D8 hthresh=3D8 wthresh=3D4=0A= TX queues=3D1 - TX desc=3D1024 - TX free threshold=3D0=0A= TX threshold registers: pthresh=3D36 hthresh=3D0 wthresh=3D0=0A= TX RS bit threshold=3D0 - TXQ flags=3D0x0=0A= testpmd> stop=0A= =0A= Telling cores to stop...=0A= Waiting for lcores to finish...=0A= =0A= ---------------------- Forward statistics for port 0 -------------------= ---=0A= RX-packets: 543761 RX-dropped: 0 RX-total: 543761=0A= Bad-ipcsum: 543558 Bad-l4csum: 0 =0A= TX-packets: 542023 TX-dropped: 0 TX-total: 542023=0A= -------------------------------------------------------------------------= ---=0A= =0A= ---------------------- Forward statistics for port 1 -------------------= ---=0A= RX-packets: 542226 RX-dropped: 0 RX-total: 542226=0A= Bad-ipcsum: 0 Bad-l4csum: 542005 =0A= TX-packets: 543575 TX-dropped: 0 TX-total: 543575=0A= -------------------------------------------------------------------------= ---=0A= =0A= +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++= ++=0A= RX-packets: 1085987 RX-dropped: 0 RX-total: 1085987=0A= TX-packets: 1085598 TX-dropped: 0 TX-total: 1085598=0A= +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= +++=0A= =0A= Done.=0A= testpmd> quit=0A= Stopping port 0...done=0A= Stopping port 1...done=0A= bye...=0A= =0A= =3D=3D 32 or more testing =3D=3D=0A= =0A= [bmbenson]~/1.3.1.1/DPDK% sudo ./x86_64-default-linuxapp-gcc/app/testpmd -c= 0xFF00FF00 -n 4 -b 0000:06:00.0 -- --portmask=3D0x3 --nb-cores=3D2 --enabl= e-rx-cksum --disable-hw-vlan --disable-rss --crc-strip --rxd=3D1024 --txd= =3D1024 --rxfreet=3D32 -i=0A= EAL: coremask set to ff00ff00=0A= EAL: Detected lcore 8 as core 0 on socket 0=0A= EAL: Detected lcore 9 as core 1 on socket 0=0A= EAL: Detected lcore 10 as core 2 on socket 0=0A= EAL: Detected lcore 11 as core 3 on socket 0=0A= EAL: Detected lcore 12 as core 4 on socket 0=0A= EAL: Detected lcore 13 as core 5 on socket 0=0A= EAL: Detected lcore 14 as core 6 on socket 0=0A= EAL: Detected lcore 15 as core 7 on socket 0=0A= EAL: Detected lcore 24 as core 0 on socket 0=0A= EAL: Detected lcore 25 as core 1 on socket 0=0A= EAL: Detected lcore 26 as core 2 on socket 0=0A= EAL: Detected lcore 27 as core 3 on socket 0=0A= EAL: Detected lcore 28 as core 4 on socket 0=0A= EAL: Detected lcore 29 as core 5 on socket 0=0A= EAL: Detected lcore 30 as core 6 on socket 0=0A= EAL: Detected lcore 31 as core 7 on socket 0=0A= EAL: Setting up hugepage memory...=0A= EAL: Ask a virtual area of 0x400000000 bytes=0A= EAL: Virtual area found at 0x7f6d00000000 (size =3D 0x400000000)=0A= EAL: Requesting 16 pages of size 1024MB from socket 0=0A= EAL: WARNING: Cannot mmap /dev/hpet! The TSC will be used instead.=0A= EAL: Master core 8 is ready (tid=3D581d800)=0A= EAL: Core 9 is ready (tid=3D4859700)=0A= EAL: Core 10 is ready (tid=3D4058700)=0A= EAL: Core 12 is ready (tid=3D3056700)=0A= EAL: Core 27 is ready (tid=3D1052700)=0A= EAL: Core 29 is ready (tid=3Dfe7fc700)=0A= EAL: Core 24 is ready (tid=3D2855700)=0A= EAL: Core 25 is ready (tid=3D2054700)=0A= EAL: Core 11 is ready (tid=3D3857700)=0A= EAL: Core 30 is ready (tid=3Dfdffb700)=0A= EAL: Core 15 is ready (tid=3Dfeffd700)=0A= EAL: Core 13 is ready (tid=3Dfffff700)=0A= EAL: Core 28 is ready (tid=3D851700)=0A= EAL: Core 31 is ready (tid=3Dfd7fa700)=0A= EAL: Core 14 is ready (tid=3Dff7fe700)=0A= EAL: Core 26 is ready (tid=3D1853700)=0A= EAL: probe driver: 8086:10d3 rte_em_pmd=0A= EAL: probe driver: 8086:10fb rte_ixgbe_pmd=0A= EAL: unbind kernel driver /sys/bus/pci/devices/0000:84:00.0/driver/unbind= =0A= EAL: bind PCI device 0000:84:00.0=0A= EAL: Device bound=0A= EAL: map PCI resource for device 0000:84:00.0=0A= EAL: PCI memory mapped at 0x7f71057b9000=0A= EAL: probe driver: 8086:10fb rte_ixgbe_pmd=0A= EAL: unbind kernel driver /sys/bus/pci/devices/0000:84:00.1/driver/unbind= =0A= EAL: bind PCI device 0000:84:00.1=0A= EAL: Device bound=0A= EAL: map PCI resource for device 0000:84:00.1=0A= EAL: PCI memory mapped at 0x7f7105799000=0A= Interactive-mode selected=0A= Configuring Port 0=0A= PMD: Disable RSC=0A= PMD: Saved register RXCSUM:3000Configuring Port 1=0A= PMD: Disable RSC=0A= PMD: Saved register RXCSUM:3000Checking link statuses...=0A= Port 0 Link Up - speed 10000 Mbps - full-duplex=0A= Port 1 Link Up - speed 10000 Mbps - full-duplex=0A= Done=0A= testpmd> set fwd csum=0A= Set csum packet forwarding mode=0A= testpmd> start=0A= csum packet forwarding - CRC stripping enabled - packets/burst=3D16=0A= nb forwarding cores=3D2 - nb forwarding ports=3D2=0A= RX queues=3D1 - RX desc=3D1024 - RX free threshold=3D32=0A= RX threshold registers: pthresh=3D8 hthresh=3D8 wthresh=3D4=0A= TX queues=3D1 - TX desc=3D1024 - TX free threshold=3D0=0A= TX threshold registers: pthresh=3D36 hthresh=3D0 wthresh=3D0=0A= TX RS bit threshold=3D0 - TXQ flags=3D0x0=0A= testpmd> stop=0A= =0A= Telling cores to stop...=0A= Waiting for lcores to finish...=0A= =0A= ---------------------- Forward statistics for port 0 -------------------= ---=0A= RX-packets: 378894 RX-dropped: 0 RX-total: 378894=0A= Bad-ipcsum: 0 Bad-l4csum: 0 =0A= TX-packets: 381197 TX-dropped: 0 TX-total: 381197=0A= -------------------------------------------------------------------------= ---=0A= =0A= ---------------------- Forward statistics for port 1 -------------------= ---=0A= RX-packets: 381197 RX-dropped: 0 RX-total: 381197=0A= Bad-ipcsum: 0 Bad-l4csum: 0 =0A= TX-packets: 378894 TX-dropped: 0 TX-total: 378894=0A= -------------------------------------------------------------------------= ---=0A= =0A= +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++= ++=0A= RX-packets: 760091 RX-dropped: 0 RX-total: 760091=0A= TX-packets: 760091 TX-dropped: 0 TX-total: 760091=0A= +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= +++=0A= =0A= =0A= [bmbenson]~/1.3.1.1/DPDK% sudo ./x86_64-default-linuxapp-gcc/app/testpmd -c= 0xFF00FF00 -n 4 -b 0000:06:00.0 -- --portmask=3D0x3 --nb-cores=3D2 --enabl= e-rx-cksum --disable-hw-vlan --disable-rss --crc-strip --rxd=3D1024 --txd= =3D1024 --rxfreet=3D64 -i=0A= EAL: coremask set to ff00ff00=0A= EAL: Detected lcore 8 as core 0 on socket 0=0A= EAL: Detected lcore 9 as core 1 on socket 0=0A= EAL: Detected lcore 10 as core 2 on socket 0=0A= EAL: Detected lcore 11 as core 3 on socket 0=0A= EAL: Detected lcore 12 as core 4 on socket 0=0A= EAL: Detected lcore 13 as core 5 on socket 0=0A= EAL: Detected lcore 14 as core 6 on socket 0=0A= EAL: Detected lcore 15 as core 7 on socket 0=0A= EAL: Detected lcore 24 as core 0 on socket 0=0A= EAL: Detected lcore 25 as core 1 on socket 0=0A= EAL: Detected lcore 26 as core 2 on socket 0=0A= EAL: Detected lcore 27 as core 3 on socket 0=0A= EAL: Detected lcore 28 as core 4 on socket 0=0A= EAL: Detected lcore 29 as core 5 on socket 0=0A= EAL: Detected lcore 30 as core 6 on socket 0=0A= EAL: Detected lcore 31 as core 7 on socket 0=0A= EAL: Setting up hugepage memory...=0A= EAL: Ask a virtual area of 0x400000000 bytes=0A= EAL: Virtual area found at 0x7f4740000000 (size =3D 0x400000000)=0A= EAL: Requesting 16 pages of size 1024MB from socket 0=0A= EAL: WARNING: Cannot mmap /dev/hpet! The TSC will be used instead.=0A= EAL: Master core 8 is ready (tid=3D75cd2800)=0A= EAL: Core 9 is ready (tid=3D74d0e700)=0A= EAL: Core 12 is ready (tid=3D6bfff700)=0A= EAL: Core 11 is ready (tid=3D73d0c700)=0A= EAL: Core 27 is ready (tid=3D6b7fe700)=0A= EAL: Core 29 is ready (tid=3D6a7fc700)=0A= EAL: Core 24 is ready (tid=3D71d08700)=0A= EAL: Core 25 is ready (tid=3D71507700)=0A= EAL: Core 13 is ready (tid=3D7350b700)=0A= EAL: Core 28 is ready (tid=3D6affd700)=0A= EAL: Core 30 is ready (tid=3D69ffb700)=0A= EAL: Core 31 is ready (tid=3D697fa700)=0A= EAL: Core 26 is ready (tid=3D70d06700)=0A= EAL: Core 15 is ready (tid=3D72509700)=0A= EAL: Core 14 is ready (tid=3D72d0a700)=0A= EAL: Core 10 is ready (tid=3D7450d700)=0A= EAL: probe driver: 8086:10d3 rte_em_pmd=0A= EAL: probe driver: 8086:10fb rte_ixgbe_pmd=0A= EAL: unbind kernel driver /sys/bus/pci/devices/0000:84:00.0/driver/unbind= =0A= EAL: bind PCI device 0000:84:00.0=0A= EAL: Device bound=0A= EAL: map PCI resource for device 0000:84:00.0=0A= EAL: PCI memory mapped at 0x7f4b75c6e000=0A= EAL: probe driver: 8086:10fb rte_ixgbe_pmd=0A= EAL: unbind kernel driver /sys/bus/pci/devices/0000:84:00.1/driver/unbind= =0A= EAL: bind PCI device 0000:84:00.1=0A= EAL: Device bound=0A= EAL: map PCI resource for device 0000:84:00.1=0A= EAL: PCI memory mapped at 0x7f4b75c4e000=0A= Interactive-mode selected=0A= Configuring Port 0=0A= PMD: Disable RSC=0A= PMD: Saved register RXCSUM:3000=0A= Configuring Port 1=0A= PMD: Disable RSC=0A= PMD: Saved register RXCSUM:3000=0A= Checking link statuses...=0A= Port 0 Link Up - speed 10000 Mbps - full-duplex=0A= Port 1 Link Up - speed 10000 Mbps - full-duplex=0A= Done=0A= testpmd> set fwd csum=0A= Set csum packet forwarding mode=0A= testpmd> =0A= testpmd> start=0A= csum packet forwarding - CRC stripping enabled - packets/burst=3D16=0A= nb forwarding cores=3D2 - nb forwarding ports=3D2=0A= RX queues=3D1 - RX desc=3D1024 - RX free threshold=3D64=0A= RX threshold registers: pthresh=3D8 hthresh=3D8 wthresh=3D4=0A= TX queues=3D1 - TX desc=3D1024 - TX free threshold=3D0=0A= TX threshold registers: pthresh=3D36 hthresh=3D0 wthresh=3D0=0A= TX RS bit threshold=3D0 - TXQ flags=3D0x0=0A= testpmd> stop=0A= =0A= Telling cores to stop...=0A= Waiting for lcores to finish...=0A= =0A= ---------------------- Forward statistics for port 0 -------------------= ---=0A= RX-packets: 395534 RX-dropped: 0 RX-total: 395534=0A= Bad-ipcsum: 0 Bad-l4csum: 0 =0A= TX-packets: 396814 TX-dropped: 0 TX-total: 396814=0A= -------------------------------------------------------------------------= ---=0A= =0A= ---------------------- Forward statistics for port 1 -------------------= ---=0A= RX-packets: 396814 RX-dropped: 0 RX-total: 396814=0A= Bad-ipcsum: 0 Bad-l4csum: 0 =0A= TX-packets: 395534 TX-dropped: 0 TX-total: 395534=0A= -------------------------------------------------------------------------= ---=0A= =0A= +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++= ++=0A= RX-packets: 792348 RX-dropped: 0 RX-total: 792348=0A= TX-packets: 792348 TX-dropped: 0 TX-total: 792348=0A= +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= +++=0A= =0A= =0A= =0A= [bmbenson]~/1.3.1.1/DPDK% sudo ./x86_64-default-linuxapp-gcc/app/testpmd -c= 0xFF00FF00 -n 4 -b 0000:06:00.0 -- --portmask=3D0x3 --nb-cores=3D2 --enabl= e-rx-cksum --disable-hw-vlan --disable-rss --crc-strip --rxd=3D1024 --txd= =3D1024 --rxfreet=3D128 -i=0A= [sudo] password for bmbenson: =0A= EAL: coremask set to ff00ff00=0A= EAL: Detected lcore 8 as core 0 on socket 0=0A= EAL: Detected lcore 9 as core 1 on socket 0=0A= EAL: Detected lcore 10 as core 2 on socket 0=0A= EAL: Detected lcore 11 as core 3 on socket 0=0A= EAL: Detected lcore 12 as core 4 on socket 0=0A= EAL: Detected lcore 13 as core 5 on socket 0=0A= EAL: Detected lcore 14 as core 6 on socket 0=0A= EAL: Detected lcore 15 as core 7 on socket 0=0A= EAL: Detected lcore 24 as core 0 on socket 0=0A= EAL: Detected lcore 25 as core 1 on socket 0=0A= EAL: Detected lcore 26 as core 2 on socket 0=0A= EAL: Detected lcore 27 as core 3 on socket 0=0A= EAL: Detected lcore 28 as core 4 on socket 0=0A= EAL: Detected lcore 29 as core 5 on socket 0=0A= EAL: Detected lcore 30 as core 6 on socket 0=0A= EAL: Detected lcore 31 as core 7 on socket 0=0A= EAL: Setting up hugepage memory...=0A= EAL: Ask a virtual area of 0x400000000 bytes=0A= EAL: Virtual area found at 0x7f9f40000000 (size =3D 0x400000000)=0A= EAL: Requesting 16 pages of size 1024MB from socket 0=0A= EAL: WARNING: Cannot mmap /dev/hpet! The TSC will be used instead.=0A= EAL: Master core 8 is ready (tid=3D4d24b800)=0A= EAL: Core 9 is ready (tid=3D4c287700)=0A= EAL: Core 10 is ready (tid=3D4ba86700)=0A= EAL: Core 14 is ready (tid=3D3ffff700)=0A= EAL: Core 25 is ready (tid=3D49a82700)=0A= EAL: Core 29 is ready (tid=3D377fe700)=0A= EAL: Core 30 is ready (tid=3D36ffd700)=0A= EAL: Core 15 is ready (tid=3D3f7fe700)=0A= EAL: Core 26 is ready (tid=3D49281700)=0A= EAL: Core 27 is ready (tid=3D48a80700)=0A= EAL: Core 13 is ready (tid=3D4a283700)=0A= EAL: Core 31 is ready (tid=3D3e7fc700)=0A= EAL: Core 11 is ready (tid=3D4b285700)=0A= EAL: Core 12 is ready (tid=3D4aa84700)=0A= EAL: Core 28 is ready (tid=3D37fff700)=0A= EAL: Core 24 is ready (tid=3D3effd700)=0A= EAL: probe driver: 8086:10d3 rte_em_pmd=0A= EAL: probe driver: 8086:10fb rte_ixgbe_pmd=0A= EAL: unbind kernel driver /sys/bus/pci/devices/0000:84:00.0/driver/unbind= =0A= EAL: bind PCI device 0000:84:00.0=0A= EAL: Device bound=0A= EAL: map PCI resource for device 0000:84:00.0=0A= EAL: PCI memory mapped at 0x7fa34d1e7000=0A= EAL: probe driver: 8086:10fb rte_ixgbe_pmd=0A= EAL: unbind kernel driver /sys/bus/pci/devices/0000:84:00.1/driver/unbind= =0A= EAL: bind PCI device 0000:84:00.1=0A= EAL: Device bound=0A= EAL: map PCI resource for device 0000:84:00.1=0A= EAL: PCI memory mapped at 0x7fa34d1c7000=0A= Interactive-mode selected=0A= Configuring Port 0=0A= PMD: Disable RSC=0A= PMD: Saved register RXCSUM:3000=0A= Configuring Port 1=0A= PMD: Disable RSC=0A= PMD: Saved register RXCSUM:3000=0A= Checking link statuses...=0A= Port 0 Link Up - speed 10000 Mbps - full-duplex=0A= Port 1 Link Up - speed 10000 Mbps - full-duplex=0A= Done=0A= testpmd> set fwd csum=0A= Set csum packet forwarding mode=0A= testpmd> start=0A= csum packet forwarding - CRC stripping enabled - packets/burst=3D16=0A= nb forwarding cores=3D2 - nb forwarding ports=3D2=0A= RX queues=3D1 - RX desc=3D1024 - RX free threshold=3D128=0A= RX threshold registers: pthresh=3D8 hthresh=3D8 wthresh=3D4=0A= TX queues=3D1 - TX desc=3D1024 - TX free threshold=3D0=0A= TX threshold registers: pthresh=3D36 hthresh=3D0 wthresh=3D0=0A= TX RS bit threshold=3D0 - TXQ flags=3D0x0=0A= testpmd> stop=0A= =0A= Telling cores to stop...=0A= Waiting for lcores to finish...=0A= =0A= ---------------------- Forward statistics for port 0 -------------------= ---=0A= RX-packets: 372239 RX-dropped: 0 RX-total: 372239=0A= Bad-ipcsum: 0 Bad-l4csum: 0 =0A= TX-packets: 375310 TX-dropped: 0 TX-total: 375310=0A= -------------------------------------------------------------------------= ---=0A= =0A= ---------------------- Forward statistics for port 1 -------------------= ---=0A= RX-packets: 375310 RX-dropped: 0 RX-total: 375310=0A= Bad-ipcsum: 0 Bad-l4csum: 0 =0A= TX-packets: 372239 TX-dropped: 0 TX-total: 372239=0A= -------------------------------------------------------------------------= ---=0A= =0A= +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++= ++=0A= RX-packets: 747549 RX-dropped: 0 RX-total: 747549=0A= TX-packets: 747549 TX-dropped: 0 TX-total: 747549=0A= +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= +++=0A= =0A= Done.=0A= =0A= =0A= =0A= =0A= ________________________________________=0A= From: dev [dev-bounces@dpdk.org] on behalf of Benson, Bryan=0A= Sent: Wednesday, November 06, 2013 7:09 PM=0A= To: dev@dpdk.org=0A= Subject: Re: [dpdk-dev] RX checksum offloading=0A= =0A= All,=0A= The receive checksum issue seems to be caused by using a RX_FREE_THRESH val= ue that is 32 or larger, as validated by the test-pmd application.=0A= I used 2 different packet types - bad IP checksum sent to port 0 and bad tc= p checksum to port 1. The way I was sending the packets did not vary betwe= en the various tests.=0A= =0A= Below is a brief summary of the testing - additional gory text is attached.= =0A= =0A= 0, 8, 16, 24, 28, 30, 31 are okay.=0A= =0A= Values above 32 are not, as tested with 32, 64 and 128.=0A= =0A= I will continue researching this - The version I used to test this is the v= anilla version of DPDK 1.3, but with the RSC disable patch applied (helps w= hen there are many ACKs).=0A= =0A= Thanks,=0A= Bryan Benson=0A= =0A= [bmbenson]~/1.3.1.1/DPDK% sudo ./x86_64-default-linuxapp-gcc/app/testpmd -= c 0xFF00FF00 -n 4 -b 0000:06:00.0 -- --portmask=3D0x3 --nb-cores=3D2 --enab= le-rx-cksum --disable-hw-vlan --disable-rss --crc-strip --rxd=3D1024 --txd= =3D1024 -i=0A= ... =0A= testpmd> set fwd csum=0A= Set csum packet forwarding mode=0A= testpmd> start=0A= csum packet forwarding - CRC stripping enabled - packets/burst=3D16=0A= nb forwarding cores=3D2 - nb forwarding ports=3D2=0A= RX queues=3D1 - RX desc=3D1024 - RX free threshold=3D0=0A= RX threshold registers: pthresh=3D8 hthresh=3D8 wthresh=3D4=0A= TX queues=3D1 - TX desc=3D1024 - TX free threshold=3D0=0A= TX threshold registers: pthresh=3D36 hthresh=3D0 wthresh=3D0=0A= TX RS bit threshold=3D0 - TXQ flags=3D0x0=0A= testpmd> stop=0A= =0A= Telling cores to stop...=0A= Waiting for lcores to finish...=0A= =0A= ---------------------- Forward statistics for port 0 -------------------= ---=0A= RX-packets: 490511 RX-dropped: 0 RX-total: 490511=0A= Bad-ipcsum: 490496 Bad-l4csum: 0=0A= TX-packets: 488720 TX-dropped: 0 TX-total: 488720=0A= -------------------------------------------------------------------------= ---=0A= =0A= ---------------------- Forward statistics for port 1 -------------------= ---=0A= RX-packets: 488804 RX-dropped: 0 RX-total: 488804=0A= Bad-ipcsum: 0 Bad-l4csum: 488704=0A= TX-packets: 490511 TX-dropped: 0 TX-total: 490511=0A= -------------------------------------------------------------------------= ---=0A= =0A= +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++= ++=0A= RX-packets: 979315 RX-dropped: 0 RX-total: 979315=0A= TX-packets: 979231 TX-dropped: 0 TX-total: 979231=0A= +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= +++=0A= =0A= Done.=0A= =0A= [bmbenson]~/1.3.1.1/DPDK% sudo ./x86_64-default-linuxapp-gcc/app/testpmd -c= 0xFF00FF00 -n 4 -b 0000:06:00.0 -- --portmask=3D0x3 --nb-cores=3D2 --enabl= e-rx-cksum --disable-hw-vlan --disable-rss --crc-strip --rxd=3D1024 --txd= =3D1024 --rxfreet=3D32 -i=0A= ... =0A= testpmd> set fwd csum=0A= Set csum packet forwarding mode=0A= testpmd> start=0A= csum packet forwarding - CRC stripping enabled - packets/burst=3D16=0A= nb forwarding cores=3D2 - nb forwarding ports=3D2=0A= RX queues=3D1 - RX desc=3D1024 - RX free threshold=3D32=0A= RX threshold registers: pthresh=3D8 hthresh=3D8 wthresh=3D4=0A= TX queues=3D1 - TX desc=3D1024 - TX free threshold=3D0=0A= TX threshold registers: pthresh=3D36 hthresh=3D0 wthresh=3D0=0A= TX RS bit threshold=3D0 - TXQ flags=3D0x0=0A= testpmd> stop=0A= =0A= Telling cores to stop...=0A= Waiting for lcores to finish...=0A= =0A= ---------------------- Forward statistics for port 0 -------------------= ---=0A= RX-packets: 378894 RX-dropped: 0 RX-total: 378894=0A= Bad-ipcsum: 0 Bad-l4csum: 0=0A= TX-packets: 381197 TX-dropped: 0 TX-total: 381197=0A= -------------------------------------------------------------------------= ---=0A= =0A= ---------------------- Forward statistics for port 1 -------------------= ---=0A= RX-packets: 381197 RX-dropped: 0 RX-total: 381197=0A= Bad-ipcsum: 0 Bad-l4csum: 0=0A= TX-packets: 378894 TX-dropped: 0 TX-total: 378894=0A= -------------------------------------------------------------------------= ---=0A= =0A= +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++= ++=0A= RX-packets: 760091 RX-dropped: 0 RX-total: 760091=0A= TX-packets: 760091 TX-dropped: 0 TX-total: 760091=0A= +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= +++=0A= =0A=