From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 89F96A034F for ; Wed, 10 Nov 2021 08:32:42 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 1E2B0410F2; Wed, 10 Nov 2021 08:32:38 +0100 (CET) Received: from mail-ua1-f46.google.com (mail-ua1-f46.google.com [209.85.222.46]) by mails.dpdk.org (Postfix) with ESMTP id 86E4A4014D for ; Wed, 10 Nov 2021 08:32:36 +0100 (CET) Received: by mail-ua1-f46.google.com with SMTP id o26so2954769uab.5 for ; Tue, 09 Nov 2021 23:32:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=semihalf-com.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=LypLh3pBCdKpucg2PYoTZkxQFndn1w6wmDP0aYYwfIw=; b=Q8QZUsTQuCGTzpMwcwsu3fKtfelF4Fr7O66n330WJyYYGgEUPYtqNTO5z2Q7b5gIoK H/D/UtQW0AaYPAn/U5ZOdkPXy6ufyYRl1qcStlZuKwXfDiQQ7DLo/gcOK3k+L940pyXL zMPlzWGd+MCDZfed0rXmyTPsnI0/OVwu+UYNuGqJGRRqLsjmiKNZkC5FR73dL7eoSAjk JERCzXy8qjwOd4C8YwE60Ilut0K7+0L0qtE0F1wyOOOJJ/jyVV0ckNbT+UrJSBeFkffA dLqEIXVDXHSpxQRLqcEWDJmLoRd+iQo8QQBgfHQDmGDONpSQgruqXyJKEPuSWMuNrY+C FTCA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=LypLh3pBCdKpucg2PYoTZkxQFndn1w6wmDP0aYYwfIw=; b=ue1hlA8sY8o9/JHtvEvHrGobhObtMVlNe8CZoo7+0HcQLmxaCDoU1jL3/0gLB0Eec9 SMHjG9q8a0sF5UegvHiUpyLCt0pVhQNikug55pz50CmUIKbZ5qRYlA2HWOzpsni0LK5u m+Ittd6Yfai5oe+zuc2Cj8MF3a62Hh7d/b1w8g7viQuVulkGsfUCW477jRa8Yf5ZnENn WMTo0QfeRXKvDK57xkAuFWnoalt47K5lSXmJaKhd+FSCIzb63ZGe0C2zE10ZEeGEZH2g 6vQY7KDTqWOxpcSIo2gkD+eu9pIeln7ktYzCrh54aOOocdkOeAPKCA7XceQulo84EJNL nkow== X-Gm-Message-State: AOAM5330oznnc0Cf3RaOnM608c7w7GnsWGZ5fWM3Zn/BBqSDHaUV+zZ5 lMiKNEqdNBpAH+ju/DNHmYpCUmx4nwmJIEntDpzQOA== X-Google-Smtp-Source: ABdhPJwV1VVy952j5DqtTXUa1ufiY0Gg25Ce6oILraBgZd7lhg+LkPKoI0lyXuZXgDmG/Ia+8X7zhrzl2Wxm0aUwNpA= X-Received: by 2002:a05:6102:304a:: with SMTP id w10mr22640743vsa.32.1636529555850; Tue, 09 Nov 2021 23:32:35 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: =?UTF-8?Q?Micha=C5=82_Krawczyk?= Date: Wed, 10 Nov 2021 08:32:23 +0100 Message-ID: Subject: Re: [dpdk-dev] RSS Hash suport in DPDK on Amazon ENA NICs broken? To: fwefew 4t4tg <7532yahoo@gmail.com> Cc: users@dpdk.org, dev , "Brandes, Shai" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org +Shai =C5=9Br., 10 lis 2021 o 00:34 fwefew 4t4tg <7532yahoo@gmail.com> napisa=C5= =82(a): > > On AWS EC2 I configure: > > - c5n.metal instance > - Stock AWS AMI Ubuntu 20.04 LTS ($ cat /proc/version > Linux version 5.4.0-1045-aws) > - Apply the vfio pci driver from https://github.com/amzn/am > zn-drivers/tree/master/userspace/dpdk/enav2-vfio-patch > - Using DPDK code from head of main branch. I built using ninja/meson > - Add a 2nd ENA enabled NIC > - Setup 2Mb huge pages, and bound the 2nd NIC with dpdk-devbind > > I run test-pmd with this command: > > $ sudo ./dpdk-testpmd --huge-dir=3D/mnt/huge -c 0xf -n 4 -- -i > EAL: Detected CPU lcores: 72 > EAL: Detected NUMA nodes: 2 > EAL: Detected static linkage of DPDK > EAL: Multi-process socket /var/run/dpdk/rte/mp_socket > EAL: Selected IOVA mode 'VA' > EAL: No available 1048576 kB hugepages reported > EAL: VFIO support initialized > EAL: Using IOMMU type 1 (Type 1) > EAL: Ignore mapping IO port bar(3) > EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:7f:00.0 (socket 0= ) > TELEMETRY: No legacy callbacks, legacy socket not created > Interactive-mode selected > Error picking flow transfer proxy for port 0: Function not implemented - > ignore > testpmd: create a new mbuf pool : n=3D171456, size=3D2176, soc= ket=3D0 > testpmd: preferred mempool ops selected: ring_mp_mc > Warning! port-topology=3Dpaired and odd forward ports number, the last po= rt > will pair with itself. > Configuring Port 0 (socket 0) > Port 0: 16:9A:11:4A:5D:61 > Checking link statuses... > Done > Error during enabling promiscuous mode for port 0: Operation not supporte= d > - ignore > > *Key point: I try to enable RSS hash offload for UDP or TCP. I get the > following error shown in bold:* > > testpmd> port config all rss udp > > *Port 0 modified RSS hash function based on hardware > support,requested:0x20820 configured:0x820*ena_rss_hash_set(): Setting RS= S > hash fields is not supported > ena_rss_hash_update(): Failed to set RSS hash > *Configuration of RSS hash at ethernet port 0 failed with error (95): > Operation not supported.* As you can see, setting RSS hash fields is not supported by the hardware. The driver provides this API call, but it cannot be processed by the hardware as it lacks this feature. If this API is not supported, the driver returns the defaults for which the RSS HF is enabled in the FW: #define ENA_ALL_RSS_HF (RTE_ETH_RSS_NONFRAG_IPV4_TCP | RTE_ETH_RSS_NONFRAG_IPV4_UDP | \ RTE_ETH_RSS_NONFRAG_IPV6_TCP | RTE_ETH_RSS_NONFRAG_IPV6_UDP) This is the 0xc30 value which you can see as 'valid value' in the 'hello_server' application. Configuration of the RSS hash key should work although the RSS HF cannot be changed. And RSS will be enabled for both the TCP and the UDP by default - however it cannot be turned off. Thanks, Michal