From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id EA5C745733 for ; Sun, 11 Aug 2024 18:15:34 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 657B6400D7; Sun, 11 Aug 2024 18:15:34 +0200 (CEST) Received: from mail-pf1-f181.google.com (mail-pf1-f181.google.com [209.85.210.181]) by mails.dpdk.org (Postfix) with ESMTP id DD78F400D5 for ; Sun, 11 Aug 2024 18:15:33 +0200 (CEST) Received: by mail-pf1-f181.google.com with SMTP id d2e1a72fcca58-70d28023accso2881056b3a.0 for ; Sun, 11 Aug 2024 09:15:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=networkplumber-org.20230601.gappssmtp.com; s=20230601; t=1723392933; x=1723997733; darn=dpdk.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:from:to:cc:subject:date :message-id:reply-to; bh=PaNFzb40iu3FJPgRRWiywvRbKqgcamEytc1m2UMdSo8=; b=Jb3J9KJZGby65xZVI4lDJB06QYzjvxc3ozrJRgk/pwDYtS8GAVEZ52j1KfpicB4rQn GGW4ylej/UHoReixRBqxDyHNmmtMPUh9DwD3/knkaJrYOU1ZJLdpm2lg2ZclGdBVJvkX DvClv4k/gKm0Y5NIQ+bHjdMedtzXYA4WzaLLgHk/Fr+Vy/wjjFo6/uQysS6V1ZtpQ//z 5OWI9kp6JV8GQSVI80XU/6pbtatnj0j/9PWngLXOW6k1KPjEHNR05A+bCxjZSUO6JR/T L7BK8DYghFzJIShN3HpIsw2YFC0tjiJLddTXUS4Yuygi8gmhx2njllWWGdPRyzdTz7tN uVRg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1723392933; x=1723997733; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=PaNFzb40iu3FJPgRRWiywvRbKqgcamEytc1m2UMdSo8=; b=OdG0IEj20Wak0kXOKb9KE5+8+s/pY4VR1QzZvJUPRcGPpuP0gASSYtG6Jm6pw2YHuU TT1edXpb34bu7rCmK21JasDt9Y8iBLYQdc1K4xLHxOQRWUEJrDVktPG70umSvN87JOmo DcYBgs6OI2Ndu1T0lW0rIxGUveM/SAKpwuBQwm63lmiXlBI/CfM/Up3AInIfIWmiWbXf wjBA/4mlZyQxMTBK01NBkGIREhMAcsh5bGYoVCzVrUWOm7mkCeieqsv4uzz2splVx+sR /JxS1oE+DTyNznBfW1Lt8XjhUDVQ39h3ABBxVgRWblJE1+UhaupbQKFCg2JC1BTZXiWU W9Ww== X-Forwarded-Encrypted: i=1; AJvYcCUb+LaKDnjv8428lWGwtLKNUvULDDebkzPW9soJPn98tX3yji0Mttsh9HHaHElWRRr2uWBa7gNGFI2cGXt73A== X-Gm-Message-State: AOJu0Yw2UMeq7MiKGJdx+DIVHVEnwrUgFHS1WhazI+snoQQ4aJ9uGnN5 29GfMIf72KjbFfY4oMfzj+5PdwsaB6dKl+bJkAvUEgdYureQu52N3aOQa8zvfQ9RWmdJbjr4/EB h X-Google-Smtp-Source: AGHT+IHz8rzuX7TfpOoQwjW2GXbj2RpzuD6MesEnMq/SR0nu+YLhT7hhlFWtj3tjjmYZSNPHEW0/QQ== X-Received: by 2002:a05:6a00:4f94:b0:70d:21b4:46ca with SMTP id d2e1a72fcca58-710dc707247mr5826920b3a.11.1723392932786; Sun, 11 Aug 2024 09:15:32 -0700 (PDT) Received: from hermes.local (204-195-96-226.wavecable.com. [204.195.96.226]) by smtp.gmail.com with ESMTPSA id d2e1a72fcca58-710e5a89f52sm2553107b3a.162.2024.08.11.09.15.32 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 11 Aug 2024 09:15:32 -0700 (PDT) Date: Sun, 11 Aug 2024 09:15:30 -0700 From: Stephen Hemminger To: Ivan Malov Cc: Fabio Fernandes , "users@dpdk.org" Subject: Re: RSS for ENA Message-ID: <20240811091530.6eedacd3@hermes.local> In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org On Sun, 11 Aug 2024 19:55:08 +0400 (+04) Ivan Malov wrote: > Hi Fabio, >=20 > Have you considered to select MQ mode 'RSS' [1] via 'dev_conf.rxmode.mq_m= ode' > during 'rte_eth_dev_configure' [2] stage? Just to double-check. >=20 > Also, the 'RSS_HASH' flag could possibly mean the availability of 32-bit = hash > value in received mbufs rather than support for RSS distribution as a who= le. >=20 > [1] https://doc.dpdk.org/api-24.07/rte__ethdev_8h.html#a586b8e86131b4ec0c= caf464e847ccf3e > [2] https://doc.dpdk.org/api-24.07/rte__ethdev_8h.html#a1a7d3a20b102fee22= 2541fda50fd87bd Please do not top post on mailing lists. > Hi, > I'm a bit puzzled why DPDK is reporting RSS to be not available on my ENA= port (at AWS) when I'm expecting it to be. >=20 > My setup is: > c7a.4xlarge > =C2=A0 =C2=A0 [ENA_COM: ena_com_validate_version]ENA device version: 0.10 > =C2=A0 =C2=A0 [ENA_COM: ena_com_validate_version]ENA controller version: = 0.0.1 implementation version 1 > 16-cores (hyper-threading disabled), > 4 ENA interfaces/network adapters, but only one (with public IP) is bound= to igb_uio > DPDK 24.07 > 6.5.0-1020-aws, > Ubuntu 22.04.4 LTS, >=20 >=20 > The device reports that 8 queues are available, but rte_eth_dev_info::rx_= offload_capa does not have RTE_ETH_RX_OFFLOAD_RSS_HASH set after calling rt= e_eth_dev_info_get(). >=20 > The flag value seems to be coming from here, > https://github.com/DPDK/dpdk/blob/b3485f4293997d35b6daecc3437bb0c183a51fb= 3/drivers/net/ena/ena_ethdev.c#L2402 > Where the offload mask is: > =C2=A0 =C2=A0 (ena_com_dev_get_features_ctx*) get_feat_ctx->offload > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 tx =3D 3 > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 rx_supported =3D 7 > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 rx_enabled =3D 0 >=20 >=20 > Isn't RSS supposed to be available on this ENA setup? >=20 > If not, how am I supposed to distribute inbound packets across those 8 re= ceive queues/CPUs? >=20 > Some notes, log: > at eth_ena_dev_init(), ena_use_large_llq_hdr() returned true > ena_get_metrics_entries(): 0x6 customer metrics are supported > ena_use_large_llq_hdr(): Recommended device entry size policy 4 > eth_ena_dev_init(): LLQ entry size 256B > eth_ena_dev_init(): Placement policy: Low latency >=20 Yes, the OFFLOAD_RSS_HASH flag indicates that the received mbuf will contai= n the hash value. This driver only does it if multi-queue is enabled (which makes sense). You need rxmode.mq_mode with RTE_ETH_MQ_RX_RSS_FLAG to make use of all 8 qu= eues.