From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-we0-f174.google.com (mail-we0-f174.google.com [74.125.82.174]) by dpdk.org (Postfix) with ESMTP id 83B44595A for ; Tue, 22 Jul 2014 17:23:51 +0200 (CEST) Received: by mail-we0-f174.google.com with SMTP id x48so9541732wes.33 for ; Tue, 22 Jul 2014 08:25:10 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:organization:user-agent :mime-version:to:cc:subject:content-type:content-transfer-encoding; bh=MTX5KaSSyPBP8dgBPcIOr849si1xjvgQkBAh1TlLAk4=; b=lEu8CpYOXd7L03w9aRER+gRpEpDK+zgSwbyqAhZbMQFynfTSKbgGlsQYsdABiE6fmU Vrc3jgSC4H9bGrvW2/MKsI4JtvfCx9h07r2QLZRRCXHK040QoFRsApFVQklwy4cmbkeK +lV9UCJ0MAjhPYaIpt15ZMhE5WQvvFdNRbM1PE+AoJKqfgivgwdecDFdjNYlc+IntM9z lByVt2y75jmrEI8z4oJhQ3NUSSMnZ1RTZe+w2c4hjZxwAuVSKl4WOWTjHlLUIHju4H3I OQgkGhlMw2Y9zIKlTLFiuqqIWDl0p7iMi2rVN9hhfv31VCC2VwADMWESF/mpaiRrWPRO ROeg== X-Gm-Message-State: ALoCoQm8Uh64UxpnmzGrCWg8hqB7kctpZdBVAU7qkmQNRYGlHo+Lm03I8CJ96A4T8D4AF+Fvz8Ao X-Received: by 10.194.187.4 with SMTP id fo4mr21252101wjc.35.1406042710868; Tue, 22 Jul 2014 08:25:10 -0700 (PDT) Received: from [10.16.0.123] (guy78-3-82-239-227-177.fbx.proxad.net. [82.239.227.177]) by mx.google.com with ESMTPSA id cz4sm54903803wib.23.2014.07.22.08.25.09 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 22 Jul 2014 08:25:10 -0700 (PDT) Message-ID: <53CE8254.2070100@6wind.com> Date: Tue, 22 Jul 2014 17:25:08 +0200 From: "didier.pallard" Organization: 6WIND User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:18.0) Gecko/20121128 Thunderbird/18.0 MIME-Version: 1.0 To: "dev@dpdk.org" Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: kvm@vger.kernel.org Subject: [dpdk-dev] DMAR errors when running testpmd on kernel >= 3.15 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Jul 2014 15:23:51 -0000 Hello, I am testing testpmd on recent kernels (>= 3.15) and i have an IOMMU problem (there are several commits around IOMMU in v3.15, they may be related with this problem): Hardware: Platform: Intel S2600IP CPU: Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz BIOS version: SE5C600.86B.02.03.0003.041920141333 NICs: 05:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01) 05:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01) 07:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01) 07:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01) Software: Linux distribution: Fedora 20 Linux kernel: >= 3.15 (tested with 3.15.6-200 fc20 and 3.16.0-rc6 vanilla) Linux boot line: BOOT_IMAGE=/boot/vmlinuz-3.15.6-200.fc20.x86_64 root=/dev/sda5 console=tty1 console=ttyS0,115200n8 intel_iommu=on iommu=pt DPDK version: 1.7.0 (also tested on master, with same result) Test: I run the following commands to start the test: echo 1024 > /proc/sys/vm/nr_hugepages mount -t hugetlbfs nodev /mnt/huge modprobe uio insmod dpdk/build/kmod/igb_uio.ko dpdk/tools/dpdk_nic_bind.py --bind=igb_uio 05:00.0 05:00.1 07:00.0 07:00.1 dpdk/build/app/testpmd --huge-dir /mnt/huge -n 4 -c 0x0001fe0001ff --socket-mem=512,0 -- --socket-num=0 -i --rxq=4 --txq=16 --portmask=0xf --rxd=128 --rxfreet=32 --rxpt=8 --rxht=8 --rxwt=0 --txd=512 --txfreet=32 --txpt=32 --txht=0 --txwt=0 --txrst=32 --txqflags=0xF00 --burst=32 --mbcache=250 --total-num-mbufs=64000 --coremask=0x0001fe0001fe When i start the traffic, i have the following messages displayed on screen: [ 1819.770528] dmar: DMAR:[DMA Read] Request device [05:00.0] fault addr 3c4160000 [ 1819.770528] DMAR:[fault reason 02] Present bit in context entry is clear [ 1819.786243] dmar: DMAR:[DMA Read] Request device [07:00.1] fault addr 3ce399000 [ 1819.786243] DMAR:[fault reason 02] Present bit in context entry is clear [ 1819.801955] dmar: DMAR:[DMA Read] Request device [05:00.1] fault addr 3ce119000 [ 1819.801955] DMAR:[fault reason 02] Present bit in context entry is clear [ 1819.817668] dmar: DMAR:[DMA Read] Request device [07:00.0] fault addr 3ce269000 [ 1819.817668] DMAR:[fault reason 02] Present bit in context entry is clear and nothing flows through the testpmd ports. The problem does not appear: - with kernel older than 3.15 - if interfaces are bound using vfio-pci instead of igb_uio - if iommu is disabled in bootline (remove intel_iommu=on iommu=pt from kernel boot line) Sometimes, only two ports instead of four have DMAR problems, the two others forward packets normally. Does someone know what may happen? thanks didier