From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 4DC2D42EC6 for ; Thu, 20 Jul 2023 07:19:42 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 39A1C410FB; Thu, 20 Jul 2023 07:19:42 +0200 (CEST) Received: from egress-ip4a.ess.de.barracuda.com (egress-ip4a.ess.de.barracuda.com [18.184.203.227]) by mails.dpdk.org (Postfix) with ESMTP id B27EF40698 for ; Mon, 10 Jul 2023 10:12:52 +0200 (CEST) Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-vi1eur04lp2054.outbound.protection.outlook.com [104.47.14.54]) by mx-outbound10-5.eu-central-1a.ess.aws.cudaops.com (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 10 Jul 2023 08:12:17 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=KnnB6eXIJC0yB1EO1d62CY9vEiZxyK+jamKRAO5rROrTse5hNo/KvyS4VrxlkZbCb7IEu1grW13rbvbc4sUYc2zMLeM0DCCAhigGK2jYOzQ3ni43nDxYcH3gC8lloOMmzR7T5XW49AqKios/FYS3b+yAyce02lUL4PNFkW7BHfEqHCWpRcOXX1uL0yu3kJZsG9v35mwaydOartvpFqVuEck3r+IEEkuIEQn6WkSq7BWvIeYpzfzvwwH66Vxf5vnqaBJdtzWy3S8iM5UCkKxYEB3B5ZQOv1MDqgzDRz9eErO8AnXPXDWYZo8ks2yGx2K8hpreP3kOhcp1ONfjiAGWCA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=/6gFv8KeX3TIQe995S48gv3N3lYXIkgnt+h5Z2g5REU=; b=oTTvW3iouS8+GPb280Z/9eFEek48ksdlUyPVf6vm0J9aJF34jxSKUVx98Ah+l6nNdL8lE/asziWs6JTLSzZ9DRyQhv/lCCssJM4kyfJbUlcvSDiEHv293Egr++LoSQ3mo1wMy5H8IkoC54uXYcItf1V3XRpOaHkwjaZYpQ32efJFjf1b3Wq48WTb3YWxs9LtjJ3oAWEmyh58L6j7dGDPKIsvBuA0hHSh/lYPshoQy72vMRfpyMdV+9HKBkS8iXECkPmfSIdaMHOC1czkIjD3lYnU0klWmR/p5+zknlPKFraBd+/tv8zTgGpFcbgBmrKNCUgzlfp6TL68qk7C55PFEw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=napatech.com; dmarc=pass action=none header.from=napatech.com; dkim=pass header.d=napatech.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=napatech.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=/6gFv8KeX3TIQe995S48gv3N3lYXIkgnt+h5Z2g5REU=; b=kVyuvkkweBvXhOIAEzydQqv3PDQ8nWA3ELW8e0Zj6yg4zEQlIHemIjASfZRMzi+qWsEGvYmJHmV0i4cDLPgdZwyAM/ePXAKrIMNi8jDGel51C67hA+vX8/Y6m+f4O8sATSpdD5Ye/RffTxoX3dZdgZwSBMKJovMyKJvTenoEsXE= Received: from VI1P190MB0029.EURP190.PROD.OUTLOOK.COM (2603:10a6:800:9e::10) by VI1P190MB0765.EURP190.PROD.OUTLOOK.COM (2603:10a6:800:122::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6565.30; Mon, 10 Jul 2023 08:12:14 +0000 Received: from VI1P190MB0029.EURP190.PROD.OUTLOOK.COM ([fe80::8cd2:7a98:1492:2ae1]) by VI1P190MB0029.EURP190.PROD.OUTLOOK.COM ([fe80::8cd2:7a98:1492:2ae1%4]) with mapi id 15.20.6565.028; Mon, 10 Jul 2023 08:12:14 +0000 From: Yurii Skrypka To: "users@dpdk.org" CC: Justas Poderys , Maksym Kovaliov Subject: dpd3-l3fwd RX offload capabilities issue inside VM Thread-Topic: dpd3-l3fwd RX offload capabilities issue inside VM Thread-Index: AQHZswUTdyAhKeIVvECWYgrsSWlZLg== Date: Mon, 10 Jul 2023 08:12:13 +0000 Message-ID: Accept-Language: uk-UA, ru-RU, en-US Content-Language: uk-UA X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=napatech.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: VI1P190MB0029:EE_|VI1P190MB0765:EE_ x-ms-office365-filtering-correlation-id: cd04ae18-b189-4469-f8ed-08db811d5e4f x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: +K4x+OH+NMwCkhK+rXmIOsGPYenUVONIPvLVu3hxovYPHIGlge9I5yz6jgyMtjkt+QO9RbXj3RqizJ+lTx7V711YCz+ApNJBjAltSk/Gv9hlGgql9MhKY14XYsV8bhWeUlvUsC8eBs0udCgQFrAdeV88SE22QKxJcgDyxJjxrWRNT5C12p/n1axzUywQlGP2NBzcXWdJi5UJ2NmaH+pj/ylo53g7M6v2x0oiwXQx7LtG/V5KDnl2G5WralNj6Pt0mWzcyJT8HXK2gSEpMWbM0cS+ElpVDGMwQxd0rvG6oD2FtmsVHTVb9XpZXmUKBCePNzDbFjMEve0hNGY7Qsx5ZwDSSOlBiVfQNzQz/gNqHq7o/XJi3jjG6JBAI51c2cHVPmUYVArK03s8b+p5PPUmY1oJZD7htNAJ5cTfOtObPO3ivBlO5ct9lKluXxTIvDc02eo+3SM/LeKk+OP1NcuhQnhMjp71khguyjXGH35GIA3yPEie90TIq9T22QiZMrMyNQ2oQyIsqWcQgKeNc24x+h6Q1lI2/5lG48ui2TSAzbmlmIgQvAoEM2dYON0VCJlwrBp1ISzfNh+6/MpQ3eB51X2Wt/hBE0+TXOItta1nLmpz2Bc2oDOrMDWvO5B1eYm5 x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:VI1P190MB0029.EURP190.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230028)(39830400003)(376002)(366004)(396003)(346002)(136003)(451199021)(186003)(6506007)(9686003)(26005)(107886003)(83380400001)(41300700001)(4326008)(64756008)(66446008)(66476007)(2906002)(66556008)(52536014)(316002)(5660300002)(8676002)(8936002)(6916009)(478600001)(66946007)(7696005)(76116006)(91956017)(71200400001)(54906003)(19627235002)(55016003)(33656002)(122000001)(38070700005)(38100700002)(86362001)(19627405001); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?windows-1251?Q?+5Q3x1ADvN75p3xPqZTna3ixbbqQny2zfQDWvf16nzlhMlUB/mH7nfTE?= =?windows-1251?Q?9QEpystnCu64ojxKyR0jNLfTOtuXornbALaUCzKTUCbntnLzRL++V1jJ?= =?windows-1251?Q?gkktrkRYEav1VIwsFf4zXQyoK+PcfbtGMw/gveK4eAgiY5jlQNNlCWAP?= =?windows-1251?Q?F71HNegvfPw1hbZnr50jEOwo4UHjoaax/VP5RYnoyaVjIMB3fiJsPZXo?= =?windows-1251?Q?SrFsnMrrbyGlq7IGs2uYWbBJesbtdA3RKLanYHynaM0rhHVmIV878/f4?= =?windows-1251?Q?elGEiZQdNUaBptIErWDkwDfqgac9YS7HjQeYUaDiAvjFLd5tf9o+qmMz?= =?windows-1251?Q?w/kSE0g0UJSWpvReKqN2wsxQINr32j9FEbQjSutwtfm2DTqJJhQ35Mqv?= =?windows-1251?Q?N2manRUnhvOLXqXa0uXwEocq4n8xGCiBSQG/wmRQ4UTp+z6EBZ/YBD7f?= =?windows-1251?Q?PNsVg8jcAyk0kwRNwonb6DZuItZ9YMNhFCYYVkiRicl4wSyYzTF8bxzR?= =?windows-1251?Q?cMMGduKCMOHE/kOYse7Nfzv5TOM7k2IrUaqvSdBcyNwXbD0/szMI9UPO?= =?windows-1251?Q?Cj+pLgdkYC6YpgDTRkLBOMCwNusb0twAzvopIxEsff4XDT+ChD7EiN3Z?= =?windows-1251?Q?nL9183Ho+BGXZ38OGYXpHt0YQT5akyw1l23zB3frng3E7ZMpfW9xjo79?= =?windows-1251?Q?4pAKz3a66J6IuWHQ9b/xb+vtkgQUDGVGfDgsoAZvW1AQPke+dYWZyL+j?= =?windows-1251?Q?QG0PBNQmQOH9Kgnod4LnppZT+8jPyyL+vHQblBHb5jUXNdoCkSMtSI4b?= =?windows-1251?Q?kFSrT4sx1hghh8j/KtPNgN2XAKGRp0Kf/6Azr0CmBMXhSKeqZBXTxtCZ?= =?windows-1251?Q?V69QDppb1HesOMPCv7Pu8PYXBfE+ATlbq/xzLb18UNYsqIPF8N6eM7YT?= =?windows-1251?Q?TyinBLWxn6VObBMAQpIFYxAwvhcPutvRuIQaG0YS8O1uXnXb1cGjWHMi?= =?windows-1251?Q?5AmVOHLYW8JrVoaK5cUgl91wL8JtQgNr2Zl4PhSRwSb2OBsoVlSKxmOe?= =?windows-1251?Q?JyNJdIuOb9p5pBnrCgt80JlQ/nY7T9npextaD8HAfg2bbGmu7WuiBNw4?= =?windows-1251?Q?lGGXjeT3Z1cksPzmESdfECSQKceWmSqiG1faOSmVFPwZezbsmPnkzQss?= =?windows-1251?Q?iH0dnTLvPeqXsXDviHSPOeVbmF+Ao0BlSWeBpx/jmTybSElphrY2GGap?= =?windows-1251?Q?u9PQsHzDTANod8Dr3BH7mkeOMDyYqz5RB7SM+yftVc25In6U0iTRw/Zn?= =?windows-1251?Q?9JZmg4GxnoXlWoL0ywmhMDuH/PxShhur+jfJdYbi6pa7YgJrvLXRvMz0?= =?windows-1251?Q?aBNLAxdSnyl1sffnXBJvInRNP6lUVrm4vBJU+GgMMPnH6sGbgJaTfpUi?= =?windows-1251?Q?f6IK0A+KNu+OCKHA9EV0nxH42Hi1r3r5x/iWjZewpTcRY6Ph3Ej4R73D?= =?windows-1251?Q?XysshS06LoqPYTVwRplt1usLrZ04kYQLbiWnXagWFY6O5ud2iyXv1fMl?= =?windows-1251?Q?wI+rQv24blXQU0NtmUCqNe6NUCeNKdLU0jEP9xUW0EVAFgpe7OtmRXmy?= =?windows-1251?Q?bNuSdpCKzAQ1mUvgh0pX4Lki5LpWGFUqbJNTqgfRrKNkY30FDZw8Di7M?= =?windows-1251?Q?KQdBhbUFXtOu8QY4qmZxYgCb+Q+LGaND?= Content-Type: multipart/alternative; boundary="_000_VI1P190MB0029C6F37D680DEC009252A99730AVI1P190MB0029EURP_" MIME-Version: 1.0 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: BIBUzhYoMHUa3IMDAV7UU1vg2V6AEWvEp6Sz547lt9Uf8dv2cRQ3oc+kH1UZdU78AKzzPQGCMkYxujCdOei3tqkKbVVsSc155GCA8OWLw04IX1v9KCfTBWrIUNR86CqPq/IzwvWeVf8+SyOiYhedp1rQqOcgD8AemfUkDVLOiYX+HQQEiiH55TNsa1q66jYdJIa9Yyl9W/iM5Gtxri5uyUuFtxdZU1Kq2wqA7H8ALwD8KuJN2jOfKFd2NNuKhLEisH+0dS74Cw7WYL7rxP5rSYgo+NAS/z53FpahUSp5B5apnxkeIv2RQwwo3knUMP0FHM8g9p3XJoGy9/qN1fgKNDBwwa9vYZR0QD+0tWlrdSnTMJhJAjRn5P/tOu6h1Yt14zcc2C0UZmIL2LJFeLZgeLSvccQ5KNoCOFDvRBQG0vk65z4waUWF4n7DknrUSNJVriAlkXc33sv+jUrfSljv1hSsUR3MNw1aXLjUaryZ1vjJVyFUys5CtrdoE8z5Y4JEp/7FP8IsYACVmckVaucsErjM9W3YDghwbtHP0eM76diOV9rlW+J2XrSGeTYPtEtJx6c5JT1F36m+Y0sceN+7iGs6heTFaJ4AY+QyOdFR2fLBdHIYs0DlItmwO5k4Cs9Ep5dRCu/EVHrT9qaCcE4660ceHhvAKzSCfg1RwjZhzWu8G6zitXiGuOkFTpfeqSQJLvPAGNd4ApDlZ1OqlswsYnj5RTxfw/bzV6XiyskKDq23ml6N36ZZHvi1rK/HvXSt8V+mDmyiI3bCtQdkZxgSD79LsfjbhTwcjoHZ8IcdYwE= X-OriginatorOrg: napatech.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: VI1P190MB0029.EURP190.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: cd04ae18-b189-4469-f8ed-08db811d5e4f X-MS-Exchange-CrossTenant-originalarrivaltime: 10 Jul 2023 08:12:13.8417 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: c4540d0b-728a-4233-9da5-9ea30c7ec3ed X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: X5BMFFG3rsv+wNKzoNvX8VQfDNZhOch1pijFzvdCcn9cnOVCHDNl5ky+/8LHuE60Dxv9rhdYGXKCqsRVYcZm9w== X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1P190MB0765 X-BESS-ID: 1688976737-302565-5467-3014-1 X-BESS-VER: 2019.1_20230706.1616 X-BESS-Apparent-Source-IP: 104.47.14.54 X-BESS-Parts: H4sIAAAAAAACAzWMvQ6EIBCE32VrC/YHFnwVc4WwEBtjcRSXGN/9MNFmMvMl3y wn1F+HGfrICY4vzBLZjbYNSJmcb4JaTZWxudg0SbIipaIFhmt6/a3vj8+OUnoOwopUWw kxKmpefbF7Z/XCORAZXJ8/fjMrQIIAAAA= X-BESS-Outbound-Spam-Score: 0.00 X-BESS-Outbound-Spam-Report: Code version 3.2, rules version 3.2.2.249390 [from cloudscan23-157.eu-central-1b.ess.aws.cudaops.com] Rule breakdown below pts rule name description ---- ---------------------- -------------------------------- 0.00 HTML_MESSAGE BODY: HTML included in message 0.00 BSF_BESS_OUTBOUND META: BESS Outbound X-BESS-Outbound-Spam-Status: SCORE=0.00 using account:ESS113687 scores of KILL_LEVEL=7.0 tests=HTML_MESSAGE, BSF_BESS_OUTBOUND X-BESS-BRTS-Status: 1 X-Mailman-Approved-At: Thu, 20 Jul 2023 07:19:40 +0200 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --_000_VI1P190MB0029C6F37D680DEC009252A99730AVI1P190MB0029EURP_ Content-Type: text/plain; charset="windows-1251" Content-Transfer-Encoding: quoted-printable Hi, team We have the problem of running the dpdk-l3fwd application inside a VM. The tool can=92t be started inside the VM with the following error message: dpdk-l3fwd -l 1 -- -p 0x3 --config=3D"(0,0,1),(1,0,1)" --parse-ptype EAL: Detected CPU lcores: 9 EAL: Detected NUMA nodes: 1 EAL: Detected static linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'PA' EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:00:04.0 (socket = -1) EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:00:05.0 (socket = -1) TELEMETRY: No legacy callbacks, legacy socket not created soft parse-ptype is enabled Neither ACL, LPM, EM, or FIB selected, defaulting to LPM L3FWD: Missing 1 or more rule files, using default instead Initializing port 0 ... Creating queues: nb_rxq=3D1 nb_txq=3D1... Port 0 mo= dified RSS hash function based on hardware support,requested:0xa38c configu= red:0 Ethdev port_id=3D0 requested Rx offloads 0xe doesn't match Rx offloads capa= bilities 0x2201 in rte_eth_dev_configure() EAL: Error - exiting with code: 1 Cause: Cannot configure device: err=3D-22, port=3D0 Could you please advise on what have been done in configuration in wrong wa= y? Please find below the details of environment preparation. Additional note: on the same VM with the same configuration testpmd is bein= g run successfully and traffic is being offloaded without any issues. Env details: 1. We use the VM image based on =91RedHat 8.8=92 with DPDK 22.11.2 LTS. = We have built DPDK inside VM with the following command: meson --buildtype=3Ddebug -Dexamples=3Dall -Dplatform=3Dgeneric x86_64-nati= ve-linuxapp-gcc ninja -C x86_64-native-linuxapp-gcc 1. Additionally, we have configured 1G huge pages. 1. We have used the following command to start the VM: taskset -c 3,5,7,9,15,17,19,21,23 /usr/libexec/qemu-kvm -enable-kvm \ -cpu host -m 8192 \ -object memory-backend-file,id=3Dmem,size=3D8192M,mem-path=3D/mnt/huge,shar= e=3Don \ -numa node,memdev=3Dmem -mem-prealloc -smp 9 \ -chardev socket,id=3Dchar0,path=3D/usr/local/var/run/stdvio5,server=3Don \ -netdev type=3Dvhost-user,id=3Dmynet0,chardev=3Dchar0,vhostforce=3Don,queue= s=3D1 \ -device virtio-net-pci,packed=3Don,mq=3Don,vectors=3D4,rx_queue_size=3D1024= ,tx_queue_size=3D1024,netdev=3Dmynet0,mac=3D52:54:00:00:0a:01,mrg_rxbuf=3Do= n \ -chardev socket,id=3Dchar1,path=3D/usr/local/var/run/stdvio6,server=3Don \ -netdev type=3Dvhost-user,id=3Dmynet1,chardev=3Dchar1,vhostforce=3Don,queue= s=3D1 \ -device virtio-net-pci,packed=3Don,mq=3Don,vectors=3D4,rx_queue_size=3D1024= ,tx_queue_size=3D1024,netdev=3Dmynet1,mac=3D52:54:00:00:0a:02,mrg_rxbuf=3Do= n \ -net user,hostfwd=3Dtcp::10021-:22 \ -net nic,macaddr=3D52:54:00:00:0a:01 \ -nographic /tmp/vm1.qcow2 1. Once VM is started the following configuration is inside the VM: modprobe uio_pci_generic sleep 3 /root/dpdk//usertools/dpdk-devbind.py --bind=3Duio_pci_generic 00:04.0 /root/dpdk//usertools/dpdk-devbind.py --bind=3Duio_pci_generic 00:05.0 ---------- /root/dpdk/usertools/dpdk-hugepages.py --show Node Pages Size Total 0 5 1Gb 5Gb Hugepages mounted on /dev/hugepages ---------- lspci 00:03.0 Ethernet controller: Intel Corporation 82540EM Gigabit Ethernet Con= troller (rev 03) 00:04.0 Ethernet controller: Red Hat, Inc. Virtio network device ---------- /root/dpdk/usertools/dpdk-devbind.py -s Network devices using DPDK-compatible driver =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 0000:00:04.0 'Virtio network device 1000' drv=3Duio_pci_generic unused=3D 0000:00:05.0 'Virtio network device 1000' drv=3Duio_pci_generic unused=3D Network devices using kernel driver =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 0000:00:03.0 '82540EM Gigabit Ethernet Controller 100e' if=3Deth2 drv=3De10= 00 unused=3Duio_pci_generic *Active* ---------- /root/dpdk/x86_64-native-linuxapp-gcc/examples/dpdk-ethtool EAL: Detected CPU lcores: 9 EAL: Detected NUMA nodes: 1 EAL: Detected static linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'PA' EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:00:04.0 (socket = -1) EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:00:05.0 (socket = -1) TELEMETRY: No legacy callbacks, legacy socket not created Number of NICs: 2 Init port 0.. Init port 1.. EthApp> drvinfo firmware version get error: (Operation not supported) Port 0 driver: net_virtio (ver: DPDK 22.11.2) firmware-version: bus-info: 0000:00:04.0 firmware version get error: (Operation not supported) Port 1 driver: net_virtio (ver: DPDK 22.11.2) firmware-version: bus-info: 0000:00:05.0 1. Host configuration: * Red Hat Enterprise Linux 8.7 (Ootpa), Linux 4.18.0-425.19.2.el8_7.x86_64 QEMU emulator version 6.2.0 (qemu-kvm-6.2.0-22.module+el8.7.0+18170+646069c= 1.2) OVS 2.17.2 DPDK 21.11.1 Thank you. With best regards, Yurii --_000_VI1P190MB0029C6F37D680DEC009252A99730AVI1P190MB0029EURP_ Content-Type: text/html; charset="windows-1251" Content-Transfer-Encoding: quoted-printable
Hi, team

 

We have the problem of running the dpdk-l3fwd app= lication inside a VM.

The tool can=92t be started inside the VM with the following erro= r message:

 

dpdk-l3fwd -l 1 -- -p 0x3 --config=3D= "(0,0,1),(1,0,1)"  --parse-ptype

 

EAL: Detected CPU lcores: 9

EAL: Detected NUMA nodes: 1

EAL: Detected static linkage of DPDK

EAL: Multi-process socket /var/run/dpdk= /rte/mp_socket

EAL: Selected IOVA mode 'PA'

EAL: Probe PCI driver: net_virtio (1af4= :1000) device: 0000:00:04.0 (socket -1)

EAL: Probe PCI driver: net_virtio (1af4= :1000) device: 0000:00:05.0 (socket -1)

TELEMETRY: No legacy callbacks, legacy = socket not created

soft parse-ptype is enabled

Neither ACL, LPM, EM, or FIB selected, = defaulting to LPM

L3FWD: Missing 1 or more rule files, us= ing default instead

Initializing port 0 ... Creating queu= es: nb_rxq=3D1 nb_txq=3D1... Port 0 modified RSS hash function based on hardware support,requested:0xa38c configured:0<= /span>

Ethdev port_id=3D0 requested Rx offlo= ads 0xe doesn't match Rx offloads capabilities 0x2201 in rte_eth_dev_configure()

EAL: Error - exiting with code: 1

  Cause: Cannot configure device: = err=3D-22, port=3D0

 

Could you please advise on what have been done in configuration i= n wrong way?

Please find below the details of environment preparation.<= /p>

 

Additional note: on the same VM with the same configuration testp= md is being run successfully and traffic is being offloaded without any issues.

 

<= span class=3D"x_x_ContentPasted0 x_ContentPasted0 ContentPasted0">Env detai= ls:

  1. We use the VM image based o= n =91RedHat 8.8=92 with DPDK 22.11.2 LTS. We have built DPDK inside VM with= the following command:


meson --buildtype=3Ddebug -Dexamples=3Dall -Dplatform= =3Dgeneric x86_64-native-linuxapp-gcc

ninja -C x86_64-native-linuxapp-gcc


  1. Additionally, we have confi= gured 1G huge pages.

 

  1. We have used the following = command to start the VM:

 =

taskset -c 3,5,7,9,15,17,19,21,23 /usr/libexec/qemu-k= vm -enable-kvm \

-cpu host -m 8192 \

-object memory-backend-file,id=3Dmem,size=3D8192M,mem= -path=3D/mnt/huge,share=3Don \

-numa node,memdev=3Dmem -mem-prealloc -smp 9 \

-chardev socket,id=3Dchar0,path=3D/usr/local/var/run/= stdvio5,server=3Don \

-netdev type=3Dvhost-user,id=3Dmynet0,chardev=3Dchar0= ,vhostforce=3Don,queues=3D1 \

-device virtio-net-pci,packed=3Don,mq=3Don,vectors=3D= 4,rx_queue_size=3D1024,tx_queue_size=3D1024,netdev=3Dmynet0,mac=3D52:54:00:= 00:0a:01,mrg_rxbuf=3Don \

-chardev socket,id=3Dchar1,path=3D/usr/local/var/run/= stdvio6,server=3Don \

-netdev type=3Dvhost-user,id=3Dmynet1,chardev=3Dchar1= ,vhostforce=3Don,queues=3D1 \

-device virtio-net-pci,packed=3Don,mq=3Don,vectors=3D= 4,rx_queue_size=3D1024,tx_queue_size=3D1024,netdev=3Dmynet1,mac=3D52:54:00:= 00:0a:02,mrg_rxbuf=3Don \

-net user,hostfwd=3Dtcp::10021-:22 \

-net nic,macaddr=3D52:54:00:00:0a:01 \

-nographic /tmp/vm1.qcow2

 

 

  1. Once VM is started the foll= owing configuration is inside the VM:

modprobe uio_pci_generic<= span style=3D"font-size:10pt">
sleep 3
/root/dpdk//usertools/dpdk-devbind.py --bind=3Duio_pci_generic 00:04.= 0
/root/dpdk//usertools/dpdk-devbind.py --bind=3Duio_pci_generic 00:05.= 0


----------


/ro= ot/dpdk/usertools/dpdk-hugepages.py --show


Node Pages Size Total
0    5     1Gb    5Gb

Hugepages mounted on /dev/hugepages


----------


lspci


00:03.0 Ethernet controller: Intel Corporation 82540EM Gigabit Ethernet Controller= (rev 03)
00:04.0 Ethernet controller: Red Hat, Inc. Virtio network device


----------

/root/dpdk= /usertools/dpdk-devbind.py -s

 

Network devices using D= PDK-compatible driver

=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

0000:00:04.0 'Virtio ne= twork device 1000' drv=3Duio_pci_generic unused=3D

0000:00:05.0 'Virtio ne= twork device 1000' drv=3Duio_pci_generic unused=3D

 

Network devices using k= ernel driver

=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D

0000:00:03.0 '82540EM G= igabit Ethernet Controller 100e' if=3Deth2 drv=3De1000 unused=3Duio_pci_generic *Active*

 

------= ----

 

/root/dpdk= /x86_64-native-linuxapp-gcc/examples/dpdk-ethtool

 

EAL: Detected CPU lcore= s: 9

EAL: Detected NUMA node= s: 1

EAL: Detected static li= nkage of DPDK

EAL: Multi-process sock= et /var/run/dpdk/rte/mp_socket

EAL: Selected IOVA mode= 'PA'

EAL: Probe PCI driver: = net_virtio (1af4:1000) device: 0000:00:04.0 (socket -1)

EAL: Probe PCI driver: = net_virtio (1af4:1000) device: 0000:00:05.0 (socket -1)

TELEMETRY: No legacy ca= llbacks, legacy socket not created

Number of NICs: 2

Init port 0..

Init port 1..

EthApp> drvinfo

firmware version get er= ror: (Operation not supported)

Port 0 driver: net_virt= io (ver: DPDK 22.11.2)

firmware-version:

bus-info: 0000:00:04.0<= /span>

firmware version get er= ror: (Operation not supported)

Port 1 driver: net_virt= io (ver: DPDK 22.11.2)

firmware-version:

bus-info: 0000:00:05.0


  1. Host configuration:

    1. R= ed Hat Enterprise Linux 8.7 (Ootpa), Linux 4.18.0-425.19.2.el8_7.x86_64
QEMU emulator = version 6.2.0 (qemu-kvm-6.2.0-22.module+el8.7.0+18170+646069c1.2)
OVS 2.17.2
DPDK 21.11.1


Thank you.

With best regards,

Yurii


--_000_VI1P190MB0029C6F37D680DEC009252A99730AVI1P190MB0029EURP_--